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Let Xt y „,n 6 N, 1 < i < n, be a triangular array of independent Revalued Gaussian random 
vectors with covariance matrices Si,n- We give necessary conditions under which the row- wise 
maxima converge to some max-stable distribution which generalizes the class of Hiisler-Reiss 
distributions. In the bivariate case the conditions will also be sufficient. Using these results, 
new models for bivariate extremes are derived explicitly. Moreover, we define a new class of 
stationary, max-stable processes as limits of suitably normalized and randomly rescaled maxima 
of n independent Gaussian processes whose finite dimensional margins coincide with the above 
limit distributions. As an application, we show that these processes realize a large set of extremal 
correlation functions, a natural dependence measure for max-stable processes. This set includes 
all functions V'CV'tC 1 ))' h G M. d , where ip is a completely monotone function and 7 is an arbitrary 
variogram. 
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1. Introduction 



It is well known that the standard normal distribution $ is in the max-domain of attrac- 
tion of the Gumbel distribution, i.e. 

lim &(b n + x/b n ) n — exp(— exp(— x)), for all 

where b n is a sequence of normalizing constants defined by 

rr-. (1/2) log log n + log(2 v /7r) f n 

b n := v/21ogn- 5 * 6V v ' +0 (logn 1 ' 2 , (1) 

V21ogn V / 

such that b n — n4>(b n ), where <f> is the standard normal density. Sibuya [22] showed that 
the maxima of i.i.d. bivariate normal distributions with correlation p < 1 asymptotically 
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always become independent. However, for triangular arrays with i.i.d. entries where the 
correlation in the different rows approaches 1 with an appropriate speed, Hiislcr and Rciss 
[15] proved that the row- wise maxima converge to a new class of max-stable bivariate 
distributions, namely 



F\(x,y) = cxp 



_*ia + ^u-"-*(a , y~ x 



2A J V 2A 



e 



x,yeR. (2) 



Here A € [0, oo] parameterizes the dependence in the limit, and oo corresponding 
to complete dependence and asymptotic independence, respectively. In fact, Kabluchko 
et al. [18] provide a simple argument that these are also the only possible limit points 
for such triangular arrays. 

More generally, Hiisler and Reiss [15] consider triangular arrays with i.i.d. entries of d- 
variate zero-mean, unit-variance normal distributions with covariance matrix S n in the 
n-th row satisfying 

lim b 2 n (ll T - E n )/2 = A e [0,oo) dxd , (3) 

n— too 

where 1 = (1, . . . , 1) T <E M. d and T denotes the transpose sign. Under this assumption, 
the row-wise maxima converge to the d-variate, max-stable Hiisler-Reiss distribution 
whose dependence structure is fully characterized by the matrix A. Note that condition 
(3) implies that all off-diagonal entries of £„ converge to 1 as n — > oo. A slightly more 
general representation is given in Kabluchko [17] in terms of Poisson point processes and 
negative definite kernels. 

In fact, it turns out that these distributions not only attract Gaussian arrays but also 
classes of related distributions. For instance, Hashorva [12] shows, that the convergence 
of maxima holds for triangular arrays of general bivariate elliptical distributions, if the 
random radius is in the domain of attraction of the Gumbel distribution. The generali- 
zation to multivariate elliptical distributions can be found in Hashorva [13]. Moreover, 
Hashorva et al. [14] prove that also non-elliptical distributions are in the domain of 
attraction of the Hiisler-Reiss distribution, for instance multivariate ^-distributions. 
Apart from being one of the few known parametric families of multivariate extreme value 
distributions, the Hiisler-Reiss distributions play a prominent role in modeling spatial 
extremes since they are the finite dimensional distributions of Brown-Resnick processes 
[6, 18]. 

In this paper we consider independent triangular arrays Xj j71 , n G N and 1 < i < n, 
where Xj )B is a zero-mean Gaussian random vector with covariance matrix £j, n . Thus, 
in each row the random variables are independent, but may have different dependence 
structures. We are interested in the convergence of row-wise maxima 

M„ = max 6„(Xj,„-6 n ), (4) 

i— l,...,n 

as n — > oo, and the respective limit distributions. 

In Section 2 we start with bivariate triangular arrays. For this purpose, we introduce a 
sequence of counting measures which capture the dependence structure in each row and 
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which is used to state necessary and sufficient conditions for the convergence of M n in 
(4). Moreover, the limits turn out to be new max-stable distributions that generalize (2). 
The results on triangular arrays are used to completely characterize the max-limits of 
independent sequences of bivariate Gaussian vectors. Explicit examples for the bivariate 
limit distributions are given at the end of this section. The multivariate case is treated 
in Section 3, giving rise to a class of d-dimensional max-stable distributions. In Section 
4, we show how these distributions arise as the finite dimensional margins of suitably 
normalized and randomly rescaled maxima of n independent Gaussian processes. In fact, 
the limit processes are max-stable, stationary random fields which can be seen as max- 
mixturcs of Brown- Resnick processes. The extremal dependence structure of the bivariate 
mixture distributions is analyzed in Section 5 in terms of the spectral measure. Further- 
more, it is shown that the processes from Section 4 offer a large variety of extremal 
correlation functions which makes them interesting for modeling dependencies in spatial 
extremes. Finally, Section 6 comprises the proofs of the main theorems. 

2. The bivariate case 

In order to state the main results in the bivariate case, we need probability measures 
on the extended positive half-line [0, oo]. To this end, let ([0, oo], d) be a compact metric 
space such that a function g : [0, oo] — > R is continuous iff it is continuous in the usual 
topology on [0, oo) and the limit lmx^oo g{x) exists in K. 

Consider a triangular array of independent bivariate Gaussian random vectors X irl = 
(xj^jXin), ueN and 1 < i < n, with zero expectation and covariance matrix 



Further, denote by pi >n = o~i }nt \fll{o~i,n,xo~i,n,2) the correlation of Xj i?1 . For n G N, we 
define a probability measure r\ n on [0, oo] x M. 2 by 



which keeps track of the variances and correlations in each row. In this general situation, 
the next theorem gives a sufficient condition in terms of r\ n for the convergence of row-wise 
maxima of this triangular array. 

Theorem 1. For n G N and 1 < i < n, let Xj jTl and rj n be defined as above. Fur- 
ther suppose that for some e > the measures (r) n )neN satisfy the uniform integrability 
condition 
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If for n — > oo, r\ n converges weakly to some probability measure r\ on [0, oo] x IR 2 , i.e. 
r/ n =>■ 77, then 

max 6„(X; „ - b n ) (6) 

1=1,... ,n 

converges in distribution to a random vector with distribution function given by 
-logics/) = / *( X+ V^^ )e-W 



[0,oo] xR 2 



y-x + 0-Y\ (a 
2A J 

<f ( A - y-a: 2 V~ 7 ) e " (j/ " 7)j ?(rf(A,e,7)), 



/or x,y£ 



Remark 1. An equivalent condition for the uniform integrability in (5) is that for some 

T > 

sup f e e{1+T) + e 7(1+r) r] n (d(\, 9, 7)) < 00. 

n£N J[0,oo]xR 2 

Remark 2. in /ac£, one can extend the distribution F n to mixture measures rj taking 
infinite mass at negative infinity. The only condition which needs to be satisfied is 



e" + e 7 7 ? (d(A,6>,7)) < 00. 

[0,oo] xR 2 

Note that the one-dimensional marginals of F v are Gumbel distributed with different 
location parameters, for instance 

-logical, 00) =exp[-x + log J e 6 rj(d(X, 9, 7))] . 

[0,oo] xR 2 

Moreover, F v is a max-stable distribution since 

F^ l (x + logn,y + \ogn) = F v (x,y), 

for all n £ N. This is a remarkable fact, since in general row- wise maxima of triangular 
arrays are not max-stable, not even if the random variables in each row are identically 
distributed. 

In order to obtain a necessary condition and to simplify the sufficient condition, we need 
to impose stronger assumptions on the univariate margins. We denote by VWi([0, 00]) the 
space of all probability measures on [0, 00]. By Helly's theorem this space is sequentially 
compact. 
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Theorem 2. Consider a triangular array of independent bivariate Gaussian random 
vectors X„ = (X^,X^), n e N and 1 < i < n, where and Xfl are standard 

normal random variables. Denote by Pi tTl the correlation of Xj,„. Let 

1 " 



71 

i=l 

6e a probability measure on [0, oo]. For n — > oo, 

max 6„(X iin - 6 n ) (8) 

l,...,n 

converges in distribution if and only if v n converges weakly to some probability measure 
v on [0, oo], i.e. v n =>• v. In this case, the limit of (8) has distribution function F v given 
by 

logics, y) = J™ $ (^A + ^) e~' + $ (a + ^) e"» i/(dA), (9) 

x, y € K. Furthermore, F v depends continuously on v , in the sense that if v n =>■ as 
n — > oo, and i/ n , j/ € A^i([0, oo]), then F Vn converges pointwise to F u . 

Remark 3. For an arbitrary probability measure v € A^i([0,oo]), let (i?j)jgN 6e a 
sequence of i.i.d. samples of v. Putting p^ n — max(l — 2i??/&„, — 1) m Theorem 2 yields 



1 - 

n £ — i 



v, a.s. 

n f— ' • 

l 

6 2/ Zaw of large numbers. Hence, (8) converges a.s. in distribution to F u . On the other 
hand, for two probability measures v,v € A^i([0, oo]) with v ^ v , it follows from the proof 
of Theorem 2 below that F v ^ Fp. 

Remark 4. If v is a probability measure on [0, oo), an alternative construction of the 
distribution F v is the following [17, Section 3]: Let Y]"!, §u f be a Poisson point process 
onM with intensity e~ u du and suppose that B has the normal distribution N(—2S 2 ,4:S 2 ) 
with random mean and variance, where S is v- distributed. Then, for a sequence (Bj),- £ N 
of i.i.d. copies of B, the bivariate random vector maXjgN(J7,, f/j + -Bj) has distribution 
F v . 

The above theorem can be applied to completely characterize the maxima of a sequence 
of independent bivariate Gaussian random vectors with unit variance. 

Corollary 1. Suppose that X; = (xf \ X^), n E N and 1 < i < n, is a sequence 
of independent bivariate Gaussian random vectors where X- and X^ are standard 
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normal random variables. Denote by pi the correlation of Xj and let 

1 - 

t=i 

be a probability measure on [0, oo]. For n — > oo, 

max &„(Xi - b n ) (10) 

i— l,...,n 

converges in distribution if and only if v n converges weakly to some probability measure v 
on [0, oo]. In this case, the limit of (10) has distribution function F v as in (9). Further- 
more, for all v € .Mi([0, oo]), F v is attained as a limit of (10) for a suitable sequence 

(Xi)igN. 

Remark 5. It is worthwhile to note that in general, the class of max- self decomposable 
distributions, i.e. the max-limits of sequences of independent (not necessarily identically 
distributed) random variables, is a proper subclass of max-infinitely- divisible distributions, 
i.e. the max-limits of triangular arrays with i.i.d. random variables in each row. The 
latter coincides with the class of max-limits of triangular arrays, where the rows are 
merely independent but not identically distributed [1, 9]. In the (bivariate) Gaussian case 
the above shows that the max-limits of i.i.d. triangular arrays, namely the Hiisler-Reiss 
distributions in (2), are a proper subclass of max-limits of independent triangular arrays, 
namely the distributions in (9), which, on the other hand, coincide with the max-limits 
of independent sequences. 

The max-stable distributions F v in Theorem 2 for v £ A^i([0, oo]) are max-mixtures 
of Hiisler-Reiss distributions with different dependency parameters. They constitute a 
large class of new bivariate max-stable distributions. We derive two of them explicitly by 
evaluating the integral in (9). 



Rayleigh distributed v 

The Rayleigh distribution has density 

U{\) = \e-&, A>0, (11) 

for a > 0. Choosing the dependence parameter A according to the Rayleigh distribution 
v a , we obtain the bivariate distribution function 

-\ogF v „(x,y) = f 
Jo 



$ A 



2A 



$ A 



x — y 
2A 



-e~^d\ (12) 
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for x, y € K. In order to evaluate this integral, we apply partial integration and use 
formulae 3.471.9 and 3.472.3 in Gradshteyn and Ryzhik [11]. Equation (12) then simplifies 
to 



F„„(x,y) = exp 



1 



x,y £ 



(13) 



where rj = ^1 + l/cr 2 £ (1, oo). Note that a parameterizes the dependence of F Va . As a 
goes to (i.e., r\ goes to oo), then the margins become equal. On the other hand, as a 
goes to oo (i.e., n goes to 1), then the margins become completely independent. 



Type-2 Gumbel distributed v 

The Type-2 Gumbel distribution has density 

f b (\) = 2b\- 3 e-^, A>0, 



(14) 



for b > 0. With similar arguments as for the Rayleigh distribution the distribution 
function F Vb , where Vb has density fb, is given by 



Fu b {x,y) = exp 



-^ e -v / ( s ^) 2+2b 



x, y £ 



Also in this case, the parameter b £ (0, oo) interpolates between complete independence 
and complete dependence of the bivariate distribution. In particular, if b — > 0, then the 
margins are equal and, on the other hand, if b — > oo then the margins are independent. 



3. The multivariate case 

Similarly as in Hiisler and Reiss [15], the results for standard bivariate Gaussian ran- 
dom vectors can be generalized to d-dimensional random vectors. To this end, define a 
triangular array of independent rf-dimensional, non-degenerate (i.e. with positive defi- 
nite covariance matrix) Gaussian random vectors X^ n = (-Xj- „, • ■ • , x[ d ^), n,d £ N and 
1 < i < n, where X\ [„, j £ {1, . . . , d}, are standard normal random variables. Denote by 
£i,n = (Pj,k(h n ))i<j k<d ^ ne correlation matrix of Xi !n . Let 1 = (1, . . . , 1) T £ W l and 

1 ™ 

i=l 

be a probability measure on the metric space [0, oo) dxd , equipped with the product 
metric. Throughout this paper, square roots of matrices are to be understood component- 
wise. For a measure r on [0, oo) dxd we will denote by t 2 the measure given by r 2 (dA) = 
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t(<1\/~R). Further, let D C [0, oo) dxd be the subspace of strictly (conditionally) negative 
definite matrices which are symmetric and have zeros on the diagonal, i.e. 

D :=| (aj, k ) 1<jtk<d = 4e [0,oo) dxd : x T Ax < for all x e R d \ {0} s.t. 

d >, 

Xi — 0, a,j t k — akj, ajj = for all 1 < j, k < d >. 



In particular, note that D is a suitable subspace for the measures rfc since r]^(D) = 1 for 



all nePj. For A = (Aj i fe) 1< ■ fc<d e [0,oo) dxd , define a family of transformed matrices by 



rz jm (A) — 2 (^ mj .mi + ^mfc,mi ^mj.mfe) 



<j,k<l-l 

where 2 < I < d and m = (mi, . . . , m;) with 1 < ni\ < • • • < m; < d. It follows from the 
proof of Lemma 2.1 in Berg et al. [3] that if A € D, then r; :m (vA) is a (strictly) positive 
definite matrix. 

Denote by S( ■ | the so-called survivor function of an Z-dimensional normal random 
vector with mean vector and covariance matrix VP. That is, if X ~ N(0, and x € 
Mr, then 5(x|\f') = P {X\ > x\, . . . , Xi > xi). If VP is not a covariance matrix we put 
S(x|tf ) = 0. 

For a fixed A = (A,- fc ) k<d G [0, oo) dxd , let 




hi, m ,A(yi,---,yi) = S[iyi- z + 2\ 2 mumi ). =1 / _ 1 |r ;im (A)j 

J VI 



dz, 



for 2 < / < d and /ii. m ,A(y) = for m = 1, ...,d. For an alternative representation 
of the multivariate Hiisler-Reiss distribution H\ see Joe [16]. With this notation we are 
now in a position to state the following theorem. 

Theorem 3. Consider a triangular array of independent d- dimensional Gaussian ran- 
dom vectors as above. If for n — > oo the measure rj n in (15) converges weakly to some 
probability measure rj on [0, oo) dxd , i.e. r\ n r\, s.t. r/ 2 (D) — 1, then 

max 6„(X ii „ - b n ) 
i=l,...,n 

converges in distribution to a random vector with distribution function given by 

v (x) r)(dA) ) , xeR d . (16) 



Hr,(xi,...,Xd) =exp / logiJ A ( 

\J[0,oo) dxd 
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Remark 6. We believe that the above theorem also holds in the case when rj has positive 
measure on non-strictly conditionally negative definite matrices, i.e. rj 2 (D) < 1. Our 
proof of this theorem however breaks down in this situation such that another technique 
might be necessary. 



4. Application to Brown-Resnick processes 

The d-dimensional Hiisler-Reiss distributions arise in the theory of maxima of Gaussian 
random fields as the finite dimensional distributions of Brown-Resnick processes [6] and 
its generalizations [18]. In this section we introduce a new class of max-stable processes 
with finite dimensional distributions given by (16) for suitable measures n. In fact, they 
are the max-limits of Gaussian random fields with random scaling in space. 
Let us briefly recall the definition of the processes introduced in Kabluchko et al. [18]. 
For a zero- mean Gaussian process {W(t),t G R d } with stationary increments, variance 
a 2 (t) and variogram 7(f) = E(W(t) — W(0)) 2 , consider i.i.d. copies {Wi,i G N} of W and 
a Poisson point process Tl^Li $Ui on M with intensity e~ u du, independent of the family 
Wi, i elf. Kabluchko et al. [18] showed that the stochastic process 

£(t) = max([/ l + VF 2 (i)-cr(i) 2 /2), teR d , (17) 

is max-stable and stationary with standard Gumbel margins and that its law depends 
only on the variogram 7. Furthermore, their results imply that the subclass belonging 
to variograms of fractional Brownian motions on K d , i.e. j(t) = \\t\\ a ,a G (0,2), are 
the max-limits of suitably rescaled Gaussian processes whose covariance functions satisfy 
the following regular variation condition [18, Theorem 17]. Let {X(t),t G R d } be a zero- 
mean, unit variance Gaussian process with covariance function C{t\, ia) = E[X(ti)X(t2)]. 
Assume that 

ft L ^S^ < 18 » 

holds uniformly for bounded ii,i2 € where L is continuous and slowly varying at 
and 7(i) = \\t\\ a , a G (0,2), is a continuous variogram. Further, define normalizing 
sequences b n as above and 

s n = inf{s > : L{s)s a = ^ 2 }. (19) 

In the next theorem we prove, that by introducing a random space scaling in Theorem 17 
in Kabluchko et al. [18], we obtain new stochastic processes which have finite dimensional 
distributions given by (16) for a certain measure rj. 



Theorem 4. Let Xi, i G N, be independent copies of the process X above, satisfying the 
regular variation assumption (18). Further, let Si, i G N, be independent random variables 



10 



S. Engelke et al. 



distributed according to a probability measure v on (0, oo). Then the finite dimensional 
distributions of the process 

Y n {t)= max b n (Xi(S^ a s n t) — b n ), t £ R d , 

i— l,...,n 

converge to the distribution in (16). More precisely, for t\, . . . ,t m £ M. d , the respective 
measure ij is concentrated on the subspace {AAo, A > 0} with Ao = (\/j{tj — tk))i<j,k<m 
and is given by 

r/(dAA ) = u(dX), (20) 

and by everywhere else. 

Remark 7. Note that, by Kolmogorov's extension theorem, the family of finite dimen- 
sional limit distributions in the above theorem gives rise to a new stationary, max-stable 
stochastic process {Y(t),t £ R d } on R d . 

In fact, it is possible to define this max-stable processes via another construction which 
allows for a broader class of variograms than those in (18). Let 

Vd = {7 : R d — > [0,oo) : 7(0) = 0,7 conditionally negative definite} 

denote the space of all variograms on R d , equipped with the product a-algebra. Further, let 
Q be an arbitrary probability measure on this space and ji, i £ N, be an i.i.d. sequence of 
random variables with distribution Q. For each i £ N, let £j be a Brown- Resnick process 
as in (17) with variogram 4rfi. Consider the max-mixtures n n of the processes £j, given 
by 

K„(t) = max £i(f) — logra, t£R d , 

i—l,...,n 

for n £ N. It can be shown that, as n — > 00, the finite dimensional distributions of the 
processes K n converge to those of a max-stable, stationary process n. The latter are given 
by the distribution in (16) with rj induced by Q. 

5. Spectral measure and Extremal Correlation 
function 

In multivariate and spatial extreme value theory it is important to have flexible and 
tractable models for spatial dependence of extremal events. On this account, in section we 
show how the mixtures of Hiisler-Reiss distributions give rise to new models for bivariate 
spectral densities and, in the spatial domain, to new classes of extremal correlation 
functions. 
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5.1. Spectral measure 

Every multivariate max-stable distribution admits a spectral representation [20, Chapter 
5], where the spectral measure contains all information about the extremal dependence. 
Recently, Cooley et al. [7] and Ballani and Schlather [2] constructed new parametric 
models for spectral measures. For the bivariate Hiisler-Reiss distribution, de Haan and 
Pereira [8] give an explicit form of its spectral density on the positive sphere S]_ = 
{(xi,x 2 ) & [0, oo) 2 , x\ + x\ = 1}. More precisely, they show that for A 6 (0, oo) 

— log F\(x,y) = / max {e~ x sin#, e~ v cosO) s\(9) dO, x,y eR, 
Jo 

and give a rather complicated expression for s\. Using the equation 

/, log tan 9\ sin 9 /, log tan 6\ , . . 

* \ - -v-) = co^n A + -V-) ' e e [o ' n/2] > 

their expression can be considerably simplified and the spectral density becomes 

For the spectral density s„ of the Hiisler-Reiss mixture distribution F v as in (9), where 
v does neither have an atom at nor at oo, wc have the relation 

/>oo 

8 V {9) = / s x (9)u{dX), 9e [O.tt/2]. 
Jo 

For the two examples at the end of Section 2 we can compute the corresponding spectral 
densities. 

Proposition 1. For the Rayleigh distribution with parameter a > 0, s Va is given by 

- | log tan 6 1 v/T+TT^ 

4Vcr 4 + cr 2 (sintfcosf?) 7 

Similarly, for the Type-2 Gumbel distribution with parameter b > 0, the spectral density 
has the form 

e~ u »W ( (log tan 6») 2 \ / 1 \ „ . 

s Vb {6) = m 1 - \ ' 1 + — ^ , 9e 0,tt/2 , 

4(sin#cos0) 3/2 V 4u 6 (0) 2 / V «b(0)/ 



uratfi tt t (0) = ^/(logtan6 l ) 2 /4 + 26. 



Figure 1 illustrates how these spectral measures interpolate between complete inde- 
pendence and complete dependence for different parameters. 
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5.2. Extremal Correlation function 

For a stationary, max-stable random field {X(t),t E E d } with Gumbel margins, a natural 
approach to measure bivariate extremal dependencies is the extremal correlation function 
p [21]. For h € M d it is determined by 

¥(X(0) < x,X(h) <x) = P(X(0) < xf- p{h \ 

for some (and hence all) i£l. For instance, for the process in (17) p is given by 

fhih) = 2 (l - <& (VtW/2)) , 

Remark 7 defines new max-stable and stationary processes and thus also extremal cor- 
relation functions. Moreover, from the construction it is obvious that processes with this 
dependence structure can be simulated easily as max-mixtures of Brown-Resnick pro- 
cesses. In fact, for an arbitrary variogram 7 and mixture measure v on (0, 00), we let the 
measure Q in this remark be the law of S 2 j, where S is ^-distributed. The corresponding 
process k possesses the extremal correlation function 

(h,v(h) = f 2(i-$(VtW)) v(ds), heR d . (21) 

Gneiting [10] analyzes this kind of scale mixtures of the complementary error function 
in a more general framework. The following proposition is a consequence of Theorem 3.7 
and 3.8 therein. 

Proposition 2. For a fixed variogram 7 the class of extremal correlation functions in 
(21) is given by all functions <p(y/ r y(h)), h G M. d , where tp : [0, 00) — > R is a continuous 
function with ip(0) = 1, lim^oo vV 1 ) = 0, and 

(-l) k ^[-^'(Vh)} (22) 
is nonnegative for infinitely many positive integers k. 

For instance, if vi is the Rayleigh distribution (11) with density / 1; we obtain 

Ar,* ih) = 2 (l - $ (A) f^ (A) d\j=l- (^t) ^ , h€ 

immediately from equation (13). In fact, fiy tUl (h) = t(;(<y(h)), where tfj(x) = l-(x/(x + 1)) 
is a completely monotone member of the Dagum family [4]. However, it is interesting to 

note, that when writing p-y, vi {h) — l f{\/l(h)) with (p{x) = 1 — [x 2 /{x 2 + l)) 1 ^ 2 as in 
Proposition 2, the function (p merely satisfies (22) but is not completely monotone. 
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Similarly, for the Type-2 Gumbel distribution with 6=1, the extremal correlation func- 
tion is given by p{h) = exp(— y/2 , y(h)). In particular, it follows that for any variogram 7 
and any r > the function 

p(h) = cxp (-r^f(h^j , heR d , 

is an extremal correlation function. Since this class of extremal correlation functions is 
closed under the operation of mixing with respect to probability measures, this implies 
that for any measure p G A^i((0, 00)) the Laplace transform Cp yields an extremal 
correlation function 

/>oo 

p^h) = Cfi{^fm) = e-'V^V(dr), heR d . 
Jo 

Equivalcntely, for any completely monotone function -0 with ^(0) = 1, the function 
VKVtC 1 )) ls an extremal correlation function. A corresponding max-stable, stationary 
random held is given by a max-mixture of Brown-Resnick processes with suitable v € 
Mi((0,oo)). 




Figure 1. Spectral densities of the Rayleigh (left) and Type-2 Gumbel (right) mixture distribution for 
different parameters a and b, respectively 
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Proof of Theorem 1. Let x, y <E K and put u n (z) = b n + z/b n , for z£l. 
logP ( . max X$ < . max < u n (y)) 

\ i— l,...,n i— ' / 

n 

£ log (l - [p(xg > «„(*)) + P(xg > U „(y)) - P (x$ > u n (x),X% > u n (y) 

n n 

E P (*2 > U ^)) - E P (4« > Ml/)) 
i=l 

n 

+ £ P (4!' > «n(«). > «n(l/)) + ^ 



i = l 



i=l 



(23) 



where i?„ is a remainder term from the Taylor expansion of log which can be bounded 

by 



|-Rn| < \ max 

Z 1=1,. ..71 



¥(X^>u n (x))+¥(X^>u n (y)) 

n 

J2 > ^{x)) + P(Xg > un(l,)) 

1=1 

For the one-dimensional margins we observe 

n n „oo 

- E p (*$ > = - E / dz 

i=l l=1 " , " re (a:)/<Ti,„,l 

n t*oo -t 
= ~E / -jr^(Un(z))dz 



(24) 



x/tri,„,i-62(l_l/ CTiiral ) 
oo 

e— * a /(2^) (fotM (d(A > ff,7)), 

[0,oo]xR 2 "'(l-S/fc 2 )z-0 



where we used 6„ = ncf)(b n ) for the last equation. For n€N, let 



(i-e/bi)x-e 



Clearly, as rt — > oo, h n converges uniformly on compact sets to the function h(9) — 
exp(# — a;). Note that h and h n are continuous functions on R. Put u> — (A, 0,7) and 
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observe for K > that 



/ h n (9)rj n (duj) - 

•Ao.oolxR 2 



'[0 : oo]xR 2 
< 



[0,oo] xl 2 



[0,oo] xl 
h n (6)l hn >KVn(du>) 



h(6)r)(du) 



[0,oo] xl 



h(8)l h>K i](du}) 



[0,oo] xl 2 



h n (9)l hn<K rin(duj) - 



[0,oo] xR 2 



h(9)l h<K n(duj) 



(25) 



By Theorem 5.5 in Billingsley [5] (see also the remark after the theorem), t^/i" 1 converges 
weakly to r\hr x . Moreover, since h\h<K and the h n \h n <K are uniformly bounded in n, 
the second summand in (25) converges to as n — > 00, for arbitrary K > 0. By the 
uniform integrability condition (5) and Fatou's Lemma we have Jj 00 j xR 2 h(9)rj(dui) < 00 
and hence, also the first summand in (25) tends to zero as K,n — » 00. Consequently, 



£P > u n (x)) -+ - / exp[- 

t~l J[0,oo]xR 2 



(x-9)} v (duj), 



Similarly, we get 



n „ 

- y, F M > - / ex p [- (» - ^ 

i=1 V J J[0,oo]xR 2 



(26) 



(27) 



Let us now show that the remainder term R n converges to zero for n — > 00. To this end, 
note that 



max P (xQ > u n (x)) = max -h n {6; n ) 

l,...,n \ ' / i— l,...,n n 



< max - e - x e 8i ^ 1+x ^ -> 0, n -> 00, (28) 

i=l,...,« n 

where #i in = 6^(1 — 1/cvn.i). In fact, by the uniform integrability (5), there is an e > 
such that for any 5 > we can find an M > 0, s.t. 



sup 



e e(1+e) nn{du) < 5. 



neN J [0,oo] x ((log M+x)/(l+e),oo)xI 

Choose n 6 N s.t. M/n < S and |a;|/6^ < e to obtain for all n > rto 
1 



max _ e -* e fc.»(i+»/&i) 



t=i,...,n n 



< max \ M /n, / 
1 -/[c 



[0,oo] X ((log M+a:)/(l+e),oo) xl 



e- x e 6 ^r, n {duj) \ < 5, 
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where we separated the ijM into those smaller or larger than (log M + x)/(l + e), re- 
spectively, and for the latter we bounded the maximum by the sum, i.e. the integral. It 
follows from (24), (26), (27) and (28) that R n converges to zero as n — > oo. We now turn 
to the third term in (23). 

n 

«n(aj)M, n ,l - Pi.nZ 



E 

i=l 



Un(»)/ffi,n,J 



1 - $ 



(i-pf,J 1/2 



z) (iz 



n 00 
1? / 



1 - $ 



t/M,»,2-f£(l-lM,«„a) 



" Pi.nUnjz) 
(1-P?.J 1/2 



[1 - $ (s n (A, 0, z, a;))] e —* a /(2«) dz Vn (doj), 

[CLooJxR 2 (l-7/f) 2 )y-7 

where we used 6 n = ntfi(b n ) for the second last equation and 

A (l-6/bl)x- z-9 Xz 



s n (A, 0, z,x) 



(i-\ybiy/i (1 - A7&2)V2 2 A (i-AV62 )V26 2- 



For n € N, let 

g n (X,9,j) = l\< bn 



[l-<f( Sn (X,9,z,x))]e- z - z2 /^dz 



(l-7/6^)V-7 

be a measurable function on [0, 00] x K 2 . It is easy to see, that as n — > 00, g n converges 
pointwise to the function 



ff(M,7) 



[1 -$(s(A,6»,z,a;))]e- z dz, 



with 



s(A, 9, z, x) := A + 



2A 



Note that g is a continuous function on [0, 00] x R 2 and 0(0,0,7) = g n (0, 0, 7) = 
e - and (,(00,0,7) = 5 „(oo,0, 7 ) = 0, for any (0, 7 ) G K 2 and n suffi- 
ciently large. In order to establish the weak convergence r\ n 9n X ?75 _1 j we show 
that g n converges uniformly on compact sets to g as n — > oo. To this end, let C = 
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[0,oo] x [0o,0i] x [70i7i] be an arbitrary compact set in [0, 00] x M 2 and let e > be 
given. First, note that instead of g n it suffices to consider the function g n , defined as 



?„(A,0, 7 ) = 1 A <6„ J [l-<f>(s n (\,6,z,x))]e z dz, 

(! — t/t>n)y-i 



since for n large enough 



00 

sup \g n (X,e,j)-g n (X,e,j)\ < l x < bn f e- z (l-e- z2 / (2b ^)dz^Q, 
(A,fl, 7 )ec J 

-2|!/|-7i 

as n — > 00, by dominated convergence. Further, for any e > 0, let z\ > — loge which 
implies e~ z dz < e. We note that for n large enough 

Sn{ x,e,z, x ) > (1 - A»/#r 1/a (a (1 + ^p) + z%L^ 

> /A + -21x1-^-^1 



2 2A 

for all A < b n , —2\y\ — 71 < z < z\ and (A, #,7) € C, independently of n e N. Hence, 
there is a Ai > s.t. for all Ai < A < b n 

l-$(s n (\,6,z,x))<ee- 2 M-^. 

Thus, for all n € N large enough, 



sup ff„(A,0,7) < 1a<6„ [ / 1 ee- 2 ^-^e- z dz+ f e~ z dz I < 2e, 
(A,e, 7 )ec,A>Ai yy_ 2 |j,|- 7l / 

and in the same manner, sup( A .e, 7 )ec ,A>Ai ff(A,0,7) < 2e. Furthermore, we observe 

lim $(s n (A,0, = l z <(i-0/62 )x _ e and lim $ (s(A, 0, z, x)) = l z<x -o- 

a^o v ' nl A^O 

Choose no € N such that for all n > uq and all € [0o,0i] we find an open interval 
(ag,bg) of size e/2 that contains {(1 — O/b^x — 6,x — 0}. Put Ig = (ag — e/A,bg + e/4), 
then we find a A > 0, s.t. for all (A, 0,7) € C, A < A , z € 7g and n > n , we have 
|$ (s n (A, 0, 2;, x)) — $ (s(A, 0, z, x)) I < e. Consequently, 



sup |5„(A,0,7) -y(A, 0,7)| 

(A,e, 7 )eC,A<A 

/■OO 

< 

(A 



/OO 
(1,61, +el z6R \ /9 ) e-*d2 < 2ee 2 \y\+^. 
-2|l/|-7i 



18 



S. Engelke et al. 



Choose ?ii € N, s.t. b ni > X±. For Ao < A < Ai and n > n\, 
\s n (X,9,z,x) - s(X,9,z,x)\ 



(29) 



A + 



2A 



1 - 



1 



X 2 z- 



< M 1 



(1 - A^) 1/2 



(l-A?/&2)l/2; (1-Af/62)V2 6 2 2A 

M 2 



(1-A?/63)V2^ 



-> 



for ?i — > oo, uniformly in z G [— 2|y| — 7i,zi] and (A, #,7) G C with A < A < Ai. Here, 
Mi and M2 are positive constants that only depend on x, y, Ao, Ai, 60, 61, 71 • Let rc.2 € N, 
s.t. for all n > max(ni,n2) the difference in (29) is less than or equal to ee~ 2 ' y '~ 71 . By 
the Lipschitz continuity of $, we obtain for all Ag < A < Ai and (A, 9, 7) € C, 



2|y|-7l 



|$ (s„(A, 6*, z, x)) - ® (s(X,6,z,x))\e z dz 



< 



< 



-2M-71 



\s n (X,0,z,x) — s(X,6,z,x)\e 2 dz + 



dz 



ee -2|j,|- 7 i g-^Z 



-2|y|-7i 

Putting the parts together yields 



: dz < 2e. 



lim sup |<7n(A,0,7) - g(X,9,-y)\ = 0. 

™^°° (A,9,7)eC 



The assumptions of Theorem 5.5 in Billingsley [5] are satisfied and therefore rj n g~ l 
converges weakly to rig -1 . By a similar argument as in (25) together with the uniform 
integrability condition (5) we obtain for n — > 00 



'[0,oo]xR 2 



lb r. 

]T P(xg > u n (x),X% > u n (y)) -+ \ 
i=i h 

Finally, partial integration gives 

g{X, 9, 7) = + e-<- fl > - * (a + V ~ X ^" 1 ) 



$ A 



y — x + 1 



2A 



-(*-<?) 



-(y-7) 



Together with (23), (26), (27) and the fact that R n converges to zero, this implies the 
desired result. □ 

Proof of Theorem 2. The sufficient part is a simple consequence of Theorem 1, where 
the covariance matrix of X^.„ is given by 

1 Pi,n 
pi,n 1 
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For the necessary part, suppose that the sequence (max^^ . ^ & n (Xi, n — & n ))n£N of bivari- 
ate random vectors converges in distribution to some random vector Y . Let the i/ n , n 6 N, 
be defined as in (7) and assume that the sequence (v n ) n€ ^ C A^i([0,oo]) does not con- 
verge. Then, by sequential compactness, it has at least two different accumulation points 
v, v g A / li([0, oo]). By the first part of this theorem, (max i=li „ b n (X. i n ~ &n)) neN con- 
verges in distribution to F v = Fp. It now suffices to show that F v = Fp implies v = v 
to conclude that (v n ) nen c .Mi([0, oo]) converges to some measure v and that Y has 
distribution F v . 

The fact that there is a one-to-one correspondence between Hiisler-Reiss distributions 
F\ and the dependence parameter A € [0, oo] is straightforward [18]. Showing a similar 
result in our case, however, requires more effort. 

To this end, for two measures v\, v 2 6 A^i([0, oo]) define random variables Y% and Y% with 
distribution F Vl and F V2 , respectively. First, suppose that ^i({oo}) = ^({oo}) = 0. For 
j = 1, 2, by Remark 4 we have the stochastic representation Yj = maxi e N([/ij, Ui^+Bij), 
where YlTLi ^Ui } are Poisson point process on K with intensity e~ u du and the {Bij)^^ 
are i.i.d. copies of the random variable Bj with normal distribution N(—2S 2 ,AS 2 ), where 
Sj is ^-distributed. Assume that 

F Ul (x,y) =F U2 (x,y), for all x, y e K, (30) 

i.e. the max-stable distributions of Y% and Y% are equal. Since a Poisson point process is 
determined by its intensity on a generating system of the c-algebra, it follows that the 
point processes ITi = E^i^u^u+b.j) and n 2 = X^i S {U ia ,U il2 +B ii2 ) are equal in 
distribution. Therefore, the measurable mapping 

h : R 2 -t R 2 , (xi,x 2 ) (0:1,2:2 - %i) 

induces two Poisson point processes h(Ui) and h(H2) on R 2 with coinciding intensity 
measures e _u duP_e 1 (dx) and e~ u duPB 2 (dx), respectively. Hence, B\ and B 2 have the 
same distribution. Denote by ipj the Laplace transform of the Gaussian mixture Bj, 
j = 1, 2. A straightforward calculation yields for u G (0, 1) 

V>j-(u) =Eexp(uBj) = / cxp(-2A 2 (u- u 2 ))vj(d\), j = 1,2. 

By Lemma 7 in Kabluchko et al. [18] this implies the equality of measures v 2 (d\) = 
i/f (dA), where v 2 (d\) — Vj(dVX) for j = 1, 2. Hence, it also holds that z/i = v 2 . 
For arbitrary ^1,^2 £ A4i([0, 00]), we first need to show that z/i({oo}) = i/ 2 ({oo}). For 
j = 1,2, observe that for n £ N 

- log (-n, 0) + log F Vj (-n, n) 

+ (l-e->j({oo}). 
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Since the curvature of 4> is negative on the positive real line, we have the estimate 



< 



2AV2tt 



__ e n e -{X+n/(2X)) 2 /2 



where the latter term converges pointwise to zero as n — ¥ oo. Moreover, it is uniformly 
bounded in n £ N and A £ [0, oo) by a constant and hence, by dominated convergence 

lim -logF Vj (-n,0) + log F v (-n,n) = ^({oo}), j = 1,2. 

It therefore follows from (30) that ^i({oo}) = ^({oo}). If ^i({oo}) < 1 we apply the 
above to the restricted probability measures Vj{ - n [0,oo))/(l — Vj({oo})) on [0,oo), 
j = 1, 2, to obtain v\ = v%- 

The last claim of the theorem follows from the fact, that the integrand in (9) is bounded 
and continuous in A for fixed and hence, for v,v n £ A^i([0,oo]), n £ N, weak 

convergence of v n to v ensures the pointwise convergence of the distribution functions. 

□ 

Proof of Corollary 1. The first statement is a consequence of Theorem 2, because 
every sequence of random vectors can be understood as a triangular array where the 
columns contain equal random vectors. 

For the second claim, let v £ A^i([0, oo]) be an arbitrary probability measure. Similarly 
as in Remark 3, define an i.i.d. sequence (i?i)i 6 N of samples of v. Choosing pi = max(l — 
2-Rf/bf, —1) as correlation of X, yields 



1 



For y £ [0, oo] with v{{y}) — we observe 

1 ™ 

f«([0,y]) = ~^l[o,3,](-Rib„/&j). 

i=l 



(31) 



Fix e > and recall from (1) that b n /^/2 log n — > 1 as n — > oo. Hence, choose n large 
enough such that i > nVCi+'O implies b n /bi < 1 + e. Let n e denote the smallest integer 
which is strictly larger than n 1 ^ 1+e " > , then (31) yields 



1 

« / n([°.»])--S 1 [0,»](^) 



< 



i—n^ 



l[o,y](Rib n /bi) 



E 

i— n e 



l[0,y](Ri) 



< 



E 1 to/(l+e),»](- R i 



Letting ft — > oo gives 



lim 

n— > oo 



1 ™ 

^«([0,y]) 1 [o.w](- R * 



<K(y/(l + e),y]), 
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Since e was arbitrary and ^({y}) = 0, it follows from the law of large numbers that v n 
converges a.s. weakly to v, as n — > oo. □ 

Proof of Theorem 3. Let u n (z) = b n + z/b n for ztl, u n (x) = (u n (xi), . . . ,u n (xd)) T 
for x £ M. d and for x, y £ W. d write x > y if Xj > j/j for all 1 < i < d. 

Let x = (xi, x d ) T £ R d be a fixed vector and = < u„(ir ; )} for n G N, 1 < 

i < n and 1 < Z < d. 



log I 



max < u„(xi), . . . , max < u n (x d ) 

— 1, n ' i— l,...,n ' 



.(d) 



U(^ 



i.n J 



R 7 - 



(32) 



where R n is a remainder term from the Taylor expansion of log. Using the same arguments 
as for the remainder term in (24), we conclude that R n converges to zero as n — > oo. By 
the additivity formula we have 



U Kn) 



.1=1 



z=i 



m:l<mi<"'<m|<o 



,fc=l 



(33) 



Consequently, by (32) and (33) it suffices to show that 
•n . 
lim Y]P(Xi n > u n (x)) = / V (1 ,...,d), A (xi, . . . ,2^) 77(dA). ( 34 ) 



Let Z = (Zi, . . . , Zd) be a standard normal random vector with independent margins 
and let K — {1, ...,d— 1}. For a vector x <E M. d let xa- = (xi, . . . ,Xd-i). If A = 
( a i.fc)i<j,fc<d e RdXd is a matrix, let A d ,K = (a d ,i,- ■ ■ ,dd,d-i), A K ,d = {di,d, ■ • -,a d -i,d) 
and Ak,k = ( a j,k)j,k£K- Similarly as in the proof of Theorem 1.1 in Hashorva et al. [14], 
we define a new matrix B i n £ R^- 1 )*^- 1 ) by 



Bi, n B in — i^i,n)K,K — cr i,nO~J. n , Oi^ n — (^i.n) K.dj 



(35) 



which is well-defined since — a i t n a in i s positive definite as the Schur comple- 

ment of (£i, n )d,d in the positive definite matrix Ej i?l . This enables us to write the vector 
Xj,„ as the joint stochastic representation 



V 

n ' ' * * ' ^i.n 



= B it7l ZK + ZdOi^ n , — Zd- 
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Therefore, since Z d is independent of Z^, 

P(X liK > tt n (x)) =P(.B i! „Z if + Z d (Tj : „ > u n (x K ),Z d > u n {x d )) 

POO 

= / P (Bi.nZ* + u n ( S )a i)n > u n (x K )) 6-V(&«)e- s - s2/(26 " ) ds 
id 

= - / 5 ( (^(11 T -£,,„)),,. ( , + s jr -*l + *6- a (^(ll T - 53 4in )) Jf 

"'aid 



(36) 



A'- 



It follows from the definition of -B^ n in equation (35) that 

Bi^nBj n = (11 T — £i : „)ft\dl T + 1(H T — ^i,n)d,K — (H T — £j,ri)i?,i? 

— (H T — Si : „)/f^(ll T — ^i,n)d, 

Together with (36) and the definition of r\ n this yields 

VP(X i , n >u n (x))= / Pn {A)rf n (dA), 
<=i Jc 

where p ra is a measurable function from D to [0,oo) given by 
f°° ( 

p n (A) = S [2A Ktd + x K - si + 2b- 2 sA K4 T dt(h ... :d) (VA) - Ab- 2 A K . d A dtK 
Further, let p be the measurable function from D to [0, oo) 



p{A) 



f s hA K4 + x K -si r di(1) ..., d) (VI)] e - s ds. 



Note that r\ n r\ if and only if rj 2 => rj 2 . In view of (34) it suffices to show that 



lim 

n— ^00 



p n {A)nl(dA) 



P (A) v 2 (dA). 



(37) 



To this end, let Aq £ D and {A n , n £ N} be a sequence in Z? that converges to Aq. We will 
show that p n (A n ) — > p(Aq) asn-> 00. By dominated convergence it is sufficient to show 
the convergence of the survivor functions. Since Aq is in D, recall that T d n (y/A~o) is 
in the space M( d -i) of (d— l)-dimensional, non-degenerate covariance matrices. More- 



over, since M.( d _i) C 



o(d-l)x(d-l) 



is open and r di(l! ... id) (VAJ - b n 2 A(A n ) K4 (A n ) dtK 



converges to 1^,(1 ,... 4 ){\/Aq), there is an uq £ N such that for all n > hq we have 
^d,(i,...,d){VAi) ~ K 2 ^{ A n)KA A n)d,K € M( d -i)- Since also 2(A n )A-, d + x K - si + 
6~ 2 s2(A„)^- jt i converges to 2(^4o).R".d + x k - si as n -> 00, we conclude that the sur- 
vivor functions converge and consequently p n (A n ) — > p(Aq). Applying Theorem 5.5 in 
Billingsley [5] yields (37) and therefore concludes the proof. 

□ 
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Proof of Theorem 4- First, note that s n denned in (19) goes to for n — > oo. For m £ 
N and pairwise different t±, . . . , t m € R we interpret the random vector (Y(ti), . . . , Y(t m )), 
conditionaliy on as the normalized maximum of n independent, yet differently 

distributed, m-variate normal random vectors 

Z i>n = (x i (S* /a s n t 1 ),...,X i {S* /a s n t r S) , n6N,i6{l n}, 

In view of (18), their covariance matrices are specified by 

(1/2)#(11 T - Cov(Z„0) = (#70S? /O (*i - t k ))L{s n )s a n + b 2 n o(L(s n )s«)) ^ 

= US- /a (t 3 -t k )) + o(l)) 
\ / i<j. 



<j,k<m 



\k<m 



because of (19) and the continuity of L. The remainder term goes to for n — > oo uni- 
formly in S^ a tj, S^ a tk € M d , as long as they stay bounded. In order to apply Theorem 
3 we define rj n as in (15) by 



1 - 

n ^ S ( v / 7(s i 2/Q (t J -t fc ))+o(i) N ) 

* — 1 V / l<3,fe<r, 



The proof of the following lemma will be given below. 

Lemma 1. For q £ N, let Z be random vector in M 9 and Vj,i 6N, a sequence of i.i.d. 
copies of V . Further, suppose €i^ n ,n € N and 1 < i < n, is a triangular array of errors 
such that || £i,n || goes to a.s. uniformly for bounded Vi, as n — > oo. For f G Ct,(K 9 ) the 
following convergence holds almost surely, 



1 n 

~y2f(Vi + e itn )^Ef(V), asn 



n 

i=l 



For a continuous, bounded function / € C&([0, oo) mxm ), this lemma yields with V = 
{\J j{Sf /a (tj ~ t k )))i<j,k<m that 



/(A)ry n (dA) -> / f(A)r)(dA), as n ->• oo, 

[0,oo) m><m J[0,oo) mxm 

where ?7 is as in (20). Thus, rj n converges weakly to rj. It remains to check the condition 
rf(D) = 1, which is fulfilled if {AA§, A > 0} c D. Since 7 is a variogram, Aq is condition- 
ally negative definite for A > 0. Suppose that there is an x G R m \ {0} s.t. x i = 
and x T AgX = 0. For some to £ {tx, ■ ■ ■ , t m } this gives 

m m 

= - ^2 XiXjj(ti - tj) = ^2 x i x j[l{ t i - t o)+l(tj - h) - 7(*» - W] = xTCx , 

(38) 
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where C — (C(U,tj))i<ij< m is a covariance matrix of a fractional Brownian motion 
{X(t) : t e R d } on R d with X(t ) = and covariance function C(s,t) = \\s — toll" + 
II* — ^o|| a ~ II s — t\\ a , s ,t G Thus, (38) implies that the Gaussian random vector 
(X(ti), . . . ,X(t m )) is degenerate. However, this contradicts the properties of fractional 
Brownian motion stated in Lemma 7.1 in Pitt [19] and therefore AAq G D for all A > 0. 
Hence, conditionally on {SijigN, the distribution function of (Y(ti), . . . , Y(t m )) converges 
by Theorem 3 pointwise to the distribution function H v . Finally, it suffices to note that 



limE[¥(Y(t 1 )<y 1 ,...,Y(t m )<y m \{S i }i^)] 

lim P(Y{t 1 )<y 1 ,...,Y{t m ) < y m \{Si} ieN ) 

Lil—>OQ 

EH v (y 1 , . . .,y m ) = H v {yi, ■ ■ . ,y m ), 



= E 



where the first equation follows by the dominated convergence theorem. 



□ 



Proof of Lemma 1. For arbitrary N > note that 

^ n \ n 1 n 

-^/C^+^.n) =-J2f( Vi+€i >^hv i \\<N+-J2f( Vi+ei ^HM>"- ( 39 ) 
i—1 i—1 i—1 

Since for arbitrary S > we find no G N such that ti^ n < S a.s. for all n > uq and 
1 < i < n with ||Vi|| < N, it follows from the uniform continuity of / on compact sets 
that almost surely 

1 " 

-^2\f(Vi + e^ n )- /(V5)|l||y«||<jv ->0, asn^oo. (40) 

8=1 

Further, observe that as n — > oo, the absolute value of the second sum in (39) is a.s. 
bounded by P(||V|| > N) sup xeMg |/(x)|, which converges to zero as N — > oo. Thus, the 
assertion follows from the law of large numbers, the triangle inequality, (39) and (40). □ 
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